An Analysis on Visual Recognizability of Onomatopoeia Using Web Images and DCNN features
نویسندگان
چکیده
In this paper, we examine the relation between onomatopoeia and images using a large number of images over the Web. The objective of this paper is to examine if the images corresponding to Japanese onomatopoeia words which express the feeling of visual appearance can be recognized by the state-of-theart visual recognition methods. In our work, first, we collect the images corresponding to onomatopoeia words using an Web image search engine, and then we filter out noise images to obtain clean dataset with automatic image re-ranking method. Next, we analyze recognizability of various kinds of onomatopoeia images by using improved Fisher vector (IFV) and deep convolutional neural network (DCNN) features. By the experiments, it has been shown that the DCNN features extracted from the layer 5 of Overfeat’s network pre-trained with the ILSVRC 2013 data have prominent ability to represent onomatopoeia images.
منابع مشابه
Tactile Experience Is Evoked by Visual Image of Materials: Evidence from Onomatopoeia
Human beings get a lot of information from a picture based on what we see and our background knowledge. However, many computer vision researches are heavily dependent on the use of image features and have paid little attention to background knowledge we use in texture processing. The present study explores the degree to which onomatopoeia evoked by visual images is affected by the multimodal ex...
متن کاملIndoor Space Recognition using Deep Convolutional Neural Network: A Case Study at MIT Campus
Global Position Systems and other navigation systems that collect spatial data through an array of sensors carried on by people and distributed in space have changed the way we navigate complex environments, such as cities. However, indoor navigation without reliable GPS signals relies on wall-mounted antennas, WiFi, or quantum sensors. Despite the gains of such technologies, underlying these n...
متن کاملAutomatic classification of Non-alcoholic fatty liver using texture features from ultrasound images
Background: Accurate and early detection of non-alcoholic fatty liver, which is a major cause of chronic diseases is very important and is vital to prevent the complications associated with this disease. Ultrasound of the liver is the most common and widely performed method of diagnosing fatty liver. However, due to the low quality of ultrasound images, the need for an automatic and intelligent...
متن کاملImage retrieval using the combination of text-based and content-based algorithms
Image retrieval is an important research field which has received great attention in the last decades. In this paper, we present an approach for the image retrieval based on the combination of text-based and content-based features. For text-based features, keywords and for content-based features, color and texture features have been used. Query in this system contains some keywords and an input...
متن کاملExtraction of Suitable Features for Breast Cancer Detection Using Dynamic Analysis of Thermographic Images
Introduction: Thermography is a non-invasive imaging technique that can be used to diagnose breast cancer. In this study, a method was presented for the extraction of suitable features in dynamic thermographic images of breast. The extracted features can help classify thermographic images as cancerous or healthy. Method: In this descriptive-analytical study, the images were taken from the IC/UF...
متن کامل